# T5 architecture optimization

Chronos-Bolt is a series of pretrained time series forecasting models supporting zero-shot prediction, based on T5 encoder-decoder architecture, trained on nearly 100 billion time series observations.

This model is a quantized version converted from google-t5/t5-3b to GGUF format using llama.cpp via ggml.ai's GGUF-my-repo space.

kazRush-kk-ru is a Kazakh-to-Russian translation model based on the T5 configuration, trained on multiple parallel datasets.

BioT5+ is a large biomedical language model based on the T5 architecture, achieving generalized biological understanding through IUPAC integration and multitask fine-tuning.

ptt5-v2 is a series of Portuguese pre-trained T5 models, continued training based on Google's original checkpoint.

A pre-trained T5 model optimized for Portuguese, based on continued training from Google's original t5-small checkpoint

A Russian text summarization model developed by SberDevices, based on the T5 architecture with 1.7B parameters

A multilingual translation model based on T5 architecture, supporting bidirectional translation between Russian, Chinese, and English

A multilingual machine translation model based on the T5 architecture, supporting 400+ languages, trained with 250 billion tokens

Medical mT5 is the first open-source multilingual text generation model for the medical domain, based on the mT5 checkpoint, supporting English, Spanish, French, and Italian.

An extractive QA model fine-tuned on the SQuAD2.0 dataset based on flan-t5-base, capable of handling question-answer pairs including unanswerable questions.

A model based on the Long-T5 architecture, specifically designed for generating popular summaries of scientific papers, transforming complex research content into text understandable by non-specialists.

A text paraphrasing model trained on the T5-base architecture, capable of generating high-quality paraphrased text, claimed to be one of the best paraphrasing models on the Hugging Face platform

A Russian pre-trained language model based on the T5 architecture, employing a mixed training strategy with 7 denoisers similar to UL2, supporting various text generation tasks.

Russian pre-trained language model based on T5 architecture, employing a UL2-like mixed training strategy with 7 denoising tasks, 1.7 billion parameters

A T5-based Solidity smart contract code generation model designed for Web3 development

FinABSA is a model trained on the T5-Large architecture for Aspect-Based Sentiment Analysis (ABSA) tasks. It can parse sentences containing multiple aspects. By replacing the target aspect with the [TGT] token, the model can focus on sentiment prediction for that specific aspect.

The first Chinese generative Q&A pre-trained T5 model, pre-trained on WuDao 180G corpus and fine-tuned on Chinese SQuAD and CMRC2018 datasets

Italian sentence embedding model based on IT5, mapping text to a 512-dimensional vector space, suitable for semantic search and clustering tasks

A small Italian sentence transformation model based on T5 architecture, suitable for semantic search and text similarity calculation

This is a text paraphrasing model for Persian language, built upon a Persian monolingual T5 model, capable of generating multiple paraphrased versions of Persian texts.

plT5 is a language model based on the T5 architecture, specifically trained on Polish corpus and optimized for the original T5 denoising tasks.

A T5 architecture-based code summarization generation model supporting explanations for multiple programming languages

AraT5 is a series of text generation models specifically designed for Arabic, including versions for Modern Standard Arabic, Twitter dialect, and a general version

Go language code documentation generation model based on T5-small architecture, supporting multi-task processing

A T5 model pre-trained on Korean and English, suitable for cross-lingual knowledge-driven response generation tasks

Pretrained model based on T5-large architecture, specifically designed for Python code summarization tasks with multi-task learning support

A pre-trained model based on the T5 architecture, specifically designed for generating Java function documentation with multi-task processing support

A Python code documentation generation model based on T5 architecture, pre-trained and fine-tuned with multi-task learning, specifically designed for generating Python function documentation

A T5-based Go language code documentation generation model specifically designed for generating descriptive documentation for Go functions

A T5 architecture-based Go language code documentation generation model, pre-trained and fine-tuned with multi-task learning, specifically designed for generating documentation for Go functions/methods.

A T5 model trained on 500,000 articles with titles, used to generate concise and accurate single-line titles for given articles.

Git commit message generation model based on T5 base architecture, optimized for tokenized Git commits

Lisp-style DSL code generation model based on T5 architecture for converting natural language descriptions into program code

A Java code comment generation model based on the T5 architecture, optimized through multi-task pre-training and fine-tuning, specifically designed to generate descriptive text for Java functions.

A Russian abstractive summarization model based on rut5-base, optimized for Russian news summarization tasks